Reinforcement learning in populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral responses in the face of neuronal variability. But in standard reinforcement learning a flip-side becomes apparent. Learning slows down with increasing population size since the global reinforcement becomes less and less related to the performance of any single neuron. We show that, in contrast, learning speeds up with increasing population size if feedback about the populationresponse modulates synaptic plasticity in addition to global reinforcement. The two feedback signals (reinforcement and population-response signal) can be encoded by ambient neurotransmitter concentrations which vary slowly, yielding a fully online plasticity rule where the learning of a stimulus is interleaved with the processing of the subsequent one. The assumption of a single additional feedback mechanism therefore reconciles biological plausibility with efficient learning

Comparing [C II], H I, and CO dynamics of nearby galaxies

The HI and CO components of the interstellar medium (ISM) are usually used to derive the dynamical mass M-dyn of nearby galaxies. Both components become too faint to be used as a tracer in observations of high-redshift galaxies. In those cases, the 158 mu m line of atomic carbon ([CII]) may be the only way to derive M-dyn. As the distribution and kinematics of the ISM tracer affects the determination of M-dyn, it is important to quantify the relative distributions of HI, CO, and [CII]. HI and CO are well-characterized observationally, however, for [CII] only very few measurements exist. Here we compare observations of CO, HI, and [CII] emission of a sample of nearby galaxies, drawn from the HERACLES, THINGS, and KINGFISH surveys. We find that within R-25, the average [CII] exponential radial profile is slightly shallower than that of the CO, but much steeper than the HI distribution. This is also reflected in the integrated spectrum ("global profile"), where the [CII] spectrum looks more like that of the CO than that of the HI. For one galaxy, a spectrally resolved comparison of integrated spectra was possible; other comparisons were limited by the intrinsic line-widths of the galaxies and the coarse velocity resolution of the [CII] data. Using high-spectral-resolution SOFIA [CII] data of a number of star forming regions in two nearby galaxies, we find that their [CII] linewidths agree better with those of the CO than the HI. As the radial extent of a given ISM tracer is a key input in deriving M-dyn from spatially unresolved data, we conclude that the relevant length-scale to use in determining M-dyn based on [CII] data, is that of the well-characterized CO distribution. This length scale is similar to that of the optical disk

Tracing Noble Gas Radionuclides in the Environment

Trace analysis of radionuclides is an essential and versatile tool in modern science and technology. Due to their ideal geophysical and geochemical properties, long-lived noble gas radionuclides, in particular, 39Ar (t1/2 = 269 yr), 81Kr (t1/2 = 2.3x10^5 yr) and 85Kr (t1/2 = 10.8 yr), have long been recognized to have a wide range of important applications in Earth sciences. In recent years, significant progress has been made in the development of practical analytical methods, and has led to applications of these isotopes in the hydrosphere (tracing the flow of groundwater and ocean water). In this article, we introduce the applications of these isotopes and review three leading analytical methods: Low-Level Counting (LLC), Accelerator Mass Spectrometry (AMS) and Atom Trap Trace Analysis (ATTA)

Variations in 24-mu m morphologies among galaxies in the Spitzer Infrared Nearby Galaxies Survey: new insights into the Hubble sequence

To study the distribution of star formation and dust emission within nearby galaxies, we measured five morphological parameters in the 3.6- and 24-μm wavebands for 65 galaxies in the Spitzer Infrared Nearby Galaxies Survey (SINGS) and eight galaxies that were serendipitously observed by SINGS. The morphological parameters demonstrate strong variations along the Hubble sequence, including statistically significant differences between S0/a-Sab and Sc-Sd galaxies. Early-type galaxies are generally found to be compact, centralized, symmetric sources in the 24-μm band, while late-type galaxies are generally found to be extended, asymmetric sources. These results suggest that the processes that increase the real or apparent sizes of galaxies\u27 bulges also lead to more centralized 24-μm dust emission. Several phenomena, such as strong nuclear star formation, Seyfert activity, or outer ring structures, may cause galaxies to deviate from the general morphological trends observed at 24 μm. We also note that the 24-μm morphologies of Sdm-Im galaxies are quite varied, with some objects appearing very compact and symmetric but others appearing diffuse and asymmetric. These variations reflect the wide variation in star formation in irregular galaxies as observed at other wavelengths. The variations in the 24-μm morphological parameters across the Hubble sequence mirror many of the morphological trends seen in other tracers of the ISM and in stellar emission. However, the 24-μm morphological parameters for the galaxies in this sample do not match the morphological parameters measured in the stellar wavebands. This implies that the distribution of dust emission is related to but not equivalent to the distribution of stellar emission

Cosmic Hydrogen Was Significantly Neutral a Billion Years After the Big Bang

The ionization fraction of cosmic hydrogen, left over from the big bang, provides crucial fossil evidence for when the first stars and quasar black holes formed in the infant universe. Spectra of the two most distant quasars known show nearly complete absorption of photons with wavelengths shorter than the Ly-alpha transition of neutral hydrogen, indicating that hydrogen in the intergalactic medium (IGM) had not been completely ionized at a redshift z~6.3, about a billion years after the big bang. Here we show that the radii of influence of ionizing radiation from these quasars imply that the surrounding IGM had a neutral hydrogen fraction of tens of percent prior to the quasar activity, much higher than previous lower limits of ~0.1%. When combined with the recent inference of a large cumulative optical depth to electron scattering after cosmological recombination from the WMAP data, our result suggests the existence of a second peak in the mean ionization history, potentially due to an early formation episode of the first stars.Comment: 14 Pages, 2 Figures. Accepted for publication in Nature. Press embargo until publishe

Molecular Gas in the Host Galaxy of a Quasar at Redshift z=6.42

Observations of the molecular gas phase in quasar host galaxies provide fundamental constraints on galaxy evolution at the highest redshifts. Molecular gas is the material out of which stars form; it can be traced by spectral line emission of carbon--monoxide (CO). To date, CO emission has been detected in more than a dozen quasar host galaxies with redshifts (z) larger 2, the record holder being at z=4.69. At these distances the CO lines are shifted to longer wavelengths, enabling their observation with sensitive radio and millimetre interferometers. Here we present the discovery of CO emission toward the quasar SDSS J114816.64+525150.3 (hereafter J1148+5251) at a redshift of z=6.42, when the universe was only 1/16 of its present age. This is the first detection of molecular gas at the end of cosmic reionization. The presence of large amounts of molecular gas (M(H_2)=2.2e10 M_sun) in an object at this time demonstrates that heavy element enriched molecular gas can be generated rapidly in the earliest galaxies.Comment: 12 pages, 2 figures. To appear in Nature, July, 200

Assessing architectural evolution: A case study

This is the post-print version of the Article. The official published can be accessed from the link below - Copyright @ 2011 SpringerThis paper proposes to use a historical perspective on generic laws, principles, and guidelines, like Lehman’s software evolution laws and Martin’s design principles, in order to achieve a multi-faceted process and structural assessment of a system’s architectural evolution. We present a simple structural model with associated historical metrics and visualizations that could form part of an architect’s dashboard. We perform such an assessment for the Eclipse SDK, as a case study of a large, complex, and long-lived system for which sustained effective architectural evolution is paramount. The twofold aim of checking generic principles on a well-know system is, on the one hand, to see whether there are certain lessons that could be learned for best practice of architectural evolution, and on the other hand to get more insights about the applicability of such principles. We find that while the Eclipse SDK does follow several of the laws and principles, there are some deviations, and we discuss areas of architectural improvement and limitations of the assessment approach

Resolving the far-IR line deficit : photoelectric heating and far-IR line cooling in NGC 1097 and NGC 4559

The physical state of interstellar gas and dust is dependent on the processes which heat and cool this medium. To probe heating and cooling of the interstellar medium over a large range of infrared surface brightness, on sub-kiloparsec scales, we employ line maps of [C II] 158 mu m, [O I] 63 mu m, and [N II] 122 mu m in NGC 1097 and NGC 4559, obtained with the Photodetector Array Camera & Spectrometer on board Herschel. We matched new observations to existing Spitzer Infrared Spectrograph data that trace the total emission of polycyclic aromatic hydrocarbons (PAHs). We confirm at small scales in these galaxies that the canonical measure of photoelectric heating efficiency, ([C II] + [O I])/TIR, decreases as the far-infrared (far-IR) color, nu f(nu)(70 mu m) nu f(nu)(100 mu m), increases. In contrast, the ratio of far-IR cooling to total PAH emission, ([C II] + [O I])/PAH, is a near constant similar to 6% over a wide range of far-IR color, 0.5 , derived from models of the IR spectral energy distribution. Emission from regions that exhibit a line deficit is characterized by an intense radiation field, indicating that small grains are susceptible to ionization effects. We note that there is a shift in the 7.7/11.3 mu m PAH ratio in regions that exhibit a deficit in ([C II] + [O I])/PAH, suggesting that small grains are ionized in these environments

Implementing Voluntary Medical Male Circumcision for HIV Prevention in Nyanza Province, Kenya: Lessons Learned during the First Year

In 2007, the World Health Organization endorsed male circumcision as an effective HIV prevention strategy. In 2008, the Government of Kenya (GoK) launched the national voluntary medical male circumcision (VMMC) program in Nyanza Province, the geographic home to the Luo, the largest non-circumcising ethnic group in Kenya. Currently, several other African countries are in the early stages of implementing this intervention.This paper uses data from a health facility needs assessment (n = 81 facilities) and a study to evaluate the implementation of VMMC services in 16 GoK facilities (n = 2,675 VMMC clients) to describe Kenya's experience in implementing the national program. The needs assessment revealed that no health facility was prepared to offer the minimum package of services as outlined by the national guidelines, and partner organizations were called upon to fill this gap. The findings concerning human resource shortages facilitated the GoK's decision to endorse trained nurses to provide VMMCs, enabling more facilities to offer the service. Findings from the evaluation study resulted in replacing voluntary counseling and testing (VCT) with provider-initiated testing and counseling (PITC) and subsequently doubling the proportion of VMMC clients tested for HIV.This paper outlines how certain challenges, like human resource shortages and low HIV test rates, were addressed through national policy changes, while other challenges, like large fluctuations in demand, were addressed locally. Currently, the program requires significant support from partner organizations, but a strategic plan is under development to continue to build capacity in GoK staff and facilities. Coordination between all parties was essential and was facilitated through the formation of national, provincial, and district VMMC task forces. The lessons learned from Kenya's VMMC implementation experience are likely generalizable to other African countries